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We study several aspects of the dynamic programming approach to 
optimal control of abstract evolution equations, including a class of semi- 
linear partial differential equations. We introduce and prove a verification 
theorem which provides a sufficient condition for optimality. Moreover we 
prove sub- and superoptimality principles of dynamic programming and 
give an explicit construction of e-optimal controls. 
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1 Introduction 

In this paper we investigate several aspects of the dynamic programming ap- 
proach to optimal control of abstract evolution equations. The optimal control 
problem we have in mind has the following form. The state equation is 
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Abstract 



{ 



x(t) = Ax(t) + b(t, x{t), u(t)), 
x(0) = x, 



(1) 



A is a linear, densely defined maximal dissipative operator in a real separable 
Hilbert space H, and we want to minimize a cost functional 

J(x;u(-))=[ L(t,x(t),u(t))dt + h(x(T)) (2) 
Jo 

over all controls 

u(-) € U[0, T] = {u : [0, T] — > U : u is measurable}, 

where U is a metric space. 

The dynamic programming approach studies the properties of the so called 
value function for the problem, identifies it as a solution of the associated 
Hamilton-Jacobi-Bellman (HJB) equation through the dynamic programming 
principle, and then tries to use this PDE to construct optimal feedback controls, 
obtain conditions for optimality, do numerical computations, etc.. There exists 
an extensive literature on the subject for optimal control of ordinary differential 
equations, i.e. when the HJB equations are finite dimensional (see for instance 
the books (H [26l [36l EB S3 G2H EfO and the references therein). The situation 
is much more complicated for optimal control of partial differential equations 
(PDE) or abstract evolution equations, i.e. when the HJB equations are infinite 
dimensional, nevertheless there is by now a large body of results on such HJB 
equations and the dynamic programming approach (O [3l [4], [5l [6l [7j [HI El [101 EXXl 
[Tjil[Tjg[T3[TJl[H 

and the references therein). Numerous notions of solutions are introduced in 
these works, the value functions are proved to be solutions of the dynamic 
programming equations, and various verification theorems and results on ex- 
istence and explicit forms of optimal feedback controls in particular cases are 
established. However, despite of these results, so far the use of the dynamic pro- 
gramming approach in the resolution of the general optimal control problems in 
infinite dimensions has been rather limited. Infinite dimensionality of the state 
space, unboundedness in the equations, lack of regularity of solutions, and often 
complicated notions of solutions requiring the use of sophisticated test functions 
are only some of the difficulties. 

We will discuss two aspects of the dynamic programming approach for a 
fairly general control problem: a verification theorem which gives a sufficient 
condition for optimality, and the problem of construction of e-optimal feedback 
controls. 

The verification theorem we prove in this paper is an infinite dimensional 
version of such a result for finite dimensional problems obtained in [57j . It is 
based on the notion of viscosity solution (see Definitions I2.4||2T6| . Regarding 
previous result in this direction we mention [UJ [22] and the material in Chapter 
6 §5 of [46], in particular Theorem 5.5 there which is based on [21]. We briefly 
discuss this result in Remark 13.61 

The construction of e-optimal controls we present here is a fairly explicit 
procedure which relies on the proof of superoptimality inequality of dynamic 
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programming for viscosity supersolutions of the corresponding Hamilton- Jacobi- 
Bellman equation. It is a delicate generalization of such a method for the finite 
dimensional case from [52]. Similar method has been used in [25] to construct 
stabilizing feedbacks for nonlinear systems and later in [42] for state constraint 
problems. The idea here is to approximate the value function by its appropri- 
ate inf-convolution which is more regular and satisfies a slightly perturbed HJB 
inequality pointwise. One can then use this inequality to construct e-optimal 
piecewise constant controls. This procedure in fact gives the superoptimal- 
ity inequality of dynamic programming and the suboptimality inequality can 
be proved similarly. There are other possible approaches to construction of e- 
optimal controls. For instance under compactness assumption on the operator 
B (see Section 4) one can approximate the value function by solutions of finite 
dimensional HJB equations with the operator A replaced by some finite dimen- 
sional operators A n (see [28]) and then use results of [52] directly to construct 
near optimal controls. Other approximation procedures are also possible. The 
method we present in this paper seems to have some advantages: it uses only 
one layer of approximations, it is very explicit and the errors in many cases can 
be made precise, and it does not require any compactness of the operator B. 
It does however require some weak continuity of the Hamiltonian and uniform 
continuity of the trajectories, uniformly in u(-). Finally we mention that the 
sub- and superoptimality inequalities of dynamic programming are interesting 
on their own. 

The paper is organized as follows. Definitions and the preliminary material 
is presented in Section 2. Section 3 is devoted to the verification theorem and an 
example where it applies in a nonsmooth case. In Section 4 we prove sub- and 
superoptimality principles of dynamic programming and show how to construct 
e-optimal controls. 

2 Notation, definitions and background 

Throughout this paper H is a real separable Hilbert space equipped with the 
inner product (•,•) and the norm || • ||. We recall that A is a linear, densely 
defined operator such that —A is maximal monotone, i.e. A generates a Co 
semigroup of contractions e sA , i.e. 

\\e sA \\ < 1 for all s > (3) 

We make the following assumptions on b and L. 

Hypothesis 2.1. 

b: [0, T] x Ti, x U -^H is continuous 

and there exist a constant M > and a local modulus of continuity ui(-,-) such 
that 

\\b{t,x,u)-b{s,y,u)\\ < M\\x-y\\ + u(\t - s\,\\x\\ V || V ||) 

for all t, s G [0, T] , u G U x,y G TL 
||6(i,0,u)|| < M for all (t,u) G [0, T] x U 
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Hypothesis 2.2. 

L : [0, T] X Ti. X U — ► R and /i : 7i — * R are continuous 

and there exist M > and a local modulus of continuity u>{-, ■) such that 

\L(t,x,u) - L(s,y,u)\, \h{x) - h(y)\ < u(\\x-y\\ +\t- s\, \\x\\ V ||y||) 

for all t,s € [0, T] , u £ U x,y £ H 
\L{t,0,u)\,\h(0)\ < M for all (t,u) E [Q,T] x U 

Remark 2.3. Notice that if we replace A and b by A = A — luI and b(t, x, u) 
with b(t, x, u) = b(t, x, u)+lox the above assumptions would cover a more general 
case 

\\e sA \\ < e us for alls > (4) 

for some u> > 0. However such b does not satisfy the assumptions of Section 
4 and may not satisfy the assumptions needed for comparison for equation 
Alternatively, by making a change of variables v(t, x) = v(t, e^x) in equation 
(E) (see J28\/ . page 275) we can always reduce the case ^ to the case when A 
satisfies (B). 

Following the dynamic programming approach we consider a family of prob- 
lems for every t £ [0, T], y € "H 

x t ,x(s) = Ax t ,x{s) + b(s,x t ,x(s),u(s)) , s 

X t ,x(t) = X 

We will write x(-) for xt, x {-) when there is no possibility of confusion. We 
consider the function 

J(t,x;u(-)) = J L(s,x(s),u(s))dt + h(x(T)), (6) 

where u(-) is in the set of admissible controls 

U[t,T] = {u: [t,T]->U : u is measurable}. 
The associated value function V : [0, T] x 7i — > R is defined by 

The Hamilton- Jacobi-Bellman (HJB) equation related to such optimal control 
problems is 

v t (t, x) + (Dv(t, x), Ax) + H{t, x, Dv(t, x)) = 
v(T,x) = h(x), {8} 

where 

H: [0,T]xHxH^R, 
H(t,x,p) = M ueU ((p,b(t,x,u)) + L(t,x,u)) 



4 



The solution of the above HJB equation is understood in the viscosity sense 
of Crandall and Lions [28, 29J which is slightly modified here. We consider two 
sets of tests functions: 

test! = {p £ C' 1 ((0, T) x H) : ip is weakly sequentially lower 

semicontinuous and A* Dip £ C((0,T) x H)} 

and 

test2 = {g£ ^((0, T) x H) : 3g , : [0, +oo) -» [0, +oo), 

and 77 € ^((O, T)) positive si. 
<? GC7 1 ([0,+^)), .g^(r)>0Vr>0, 
g' o (0)=0andg{t,x)=r)(t)g o (\\x\\) 
V(t,x) £ (0,T) x ft} 

We use test2 functions that are a little different from the ones used in [28]. The 
extra term 7i(-) in test2 functions is added to deal with unbounded solutions. 
We recall that D<p and Dg stand for the Frechet derivatives of these functions. 

Definition 2.4. A function v £ C((0,T] x Ti) is a (viscosity) subsolution of 
the HJB equation if 

V (T, x) < h(x) for all x £ H 

and whenever v — p — g has a local maximum at (t, x) £ [0, T) x H for p <E testl 
and g £ testl, we have 

p t (i,x) + g t (t : x) + (A*D<p(t,x),x) + H(t,x,Dp(t,x) + Dg(t,x)) > 0. (9) 

Definition 2.5. A function v £ C((0,T] x TL) is a (viscosity) supersolution of 
the HJB equation $3) if 

V (T, x) > h(x) for all x £ H 

and whenever v + p + g has a local minimum at (t, x) £ [0, T) x H for p £ testl 
and g £ test2, we have 

-pt(i,x)-g t (i,x)-(A*Dp(i,x),x)+H(i,x,-Dp{t,x)-Dg(i,x)) < 0. (10) 

Definition 2.6. A function v £ C((0,T] x Ti) is a (viscosity) solution of the 
HJB equation if it is at the same time a subsolution and a supersolution. 

We will be also using viscosity sub- and supersolutions in situations where 
no terminal values are given in (jHJ. We will then call a viscosity subsolution 
(respectively, supersolution) simply a function that satisfies © (respectively, 

TO- 
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Lemma 2.7. Let Hypotheses \2.1\ and \2.2\ hold. Let <f> £ testl and (t,x) £ 
(0,T) x H. Then the following convergence holds uniformly in u(-) £ U[t,T]: 

lim ( - ((p(s,x t x (s)) - (p(t,x)) - (p t (t,x) - (A*D(p(t,x),x) 

sit \s — t 



1 



s - 1 

Moreover we have for s — t sufficiently small 



(D<p(t, x), b(t, x, u(r))) dr = (11) 



tp(s,x t}X (s)) - tp(t,x) = J <pt(r,x t ,x(r)) + {A*Dtp(r,x t ,x(r)),x t , x (r)) 

+ (D<p{r, x t , x (r)), b(r, x t , x (r), tt(r))) dr (12) 

Proof. See [46] Lemma 3.3 page 240 and Proposition 5.5 page 67. □ 

Lemma 2.8. Let Hypotheses \2.1\ and \2.2\ hold. Let g £ testl and (t, x) £ 
(0, T) x H. Then fors-t^0+ 

(g{s,xt, x (s)) - g(t,x)) < g t (t,x) 



s - t 

1 



s-t 

where o(l) is uniform in u(-) £ U[t,T] 



(Dg(t,x),b(t,x,u(r)))dr + o(l) (13) 



Proof. To prove the statement when x ^ we use the fact that, in this case 
(see [46] page 241, equation (3.11)), 

\\x t ,x{ s )\\ < + J (^,b(t,x,u(r))jdr + o(s-t) 

So we have 

g{s,xt, x (s)) -g[t,x) = i](s)g (\\x t , x {s)\\) - v(t)go{\\x\\) 

<v(s)9o (\\ X W+J (j^Mt,xMr)))dr + o( S -t)^ - V (t)g Q (\\x\\) 
<v'(t)g (\\x\\)(s-t)+ri(t)g' (\\x\\) Qf (^ b(t,xMr))}&) +o(s-t) 
= g t (t,x){s-t)+ f (Dg{t,x),b(t,x,u(r))) dr + o(s - t) (14) 



where o(s — t) is uniform in u(-). When x = 0, using the fact that g' (0) = 0, we 
get 

g(s,x t<x (s)) - g(t,x) = g t (t,x)(s - t)+o(s-t+ \\x t , x (s)\\) 

and (|T3|) follows upon noticing that ||a:t,a:(s)|| < C(s — t) for some C independent 
of u(-) £ U[t,T}. ' □ 
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Theorem 2.9. Let Hypotheses \2.1\ and \2.2\ hold. Then the value function V 
(defined in ^)) is a viscosity solution of the HJB equation (0). 

Proof. The proof is quite standard and can be obtained with small changes 
(due to the small differences in the definition of test2 functions) from Theorem 
2.2, page 229 of 06] and the proof of Theorem 3.2, page 240 of [46] (or from 
[29]). □ 

We will need a comparison result in the proof of the verification theorem. 
There are various versions of such results for equation ([8]) available in the lit- 
erature, several sufficient sets of hypotheses can be found in [28, 29J. Since we 
are not interested in the comparison result itself we choose to assume a form of 
comparison theorem as a hypothesis. 

Hypothesis 2.10. There exists a set Q C C([0,T] x TL) such that: 
(i) the value function V is in Q; 

(ii) if v\,V2 € G, v\ is a subsolution of the HJB equation (0) and V2 is a 
supersolution of the HJB equation f2j) then v\ <V2- 

Note that from (i) and (ii) we know that V is the only solution of the HJB 
equation JH]) in Q. 

We will use the following lemma whose proof can be found in [56], page 270. 

Lemma 2.11. Let g € C([0,T];K). We extend g to a function (still denoted 
by g) on (— oo, +oo) by setting g(t) = g(T) for t > T and g{t) — g(0) for t < 0. 
Suppose there is a function p € L 1 (0,T;IR) such that 

limsup 9{t + k l~ 9{t) <p(t) a.e.te[0,T}. 

Then 

g(P)-g(a)< f limsup g{t + h \ - 9 ^ dt V < a < (3 < T. 
We will denote by Br the open ball of radius R centered at in 7i. 

3 The verification theorem 

We first introduce a set related to a subset of the superdifferential of a function 
in C((0, T) x TL). Its definition is suggested by the definition of a sub/super 
solution. We recall that the superdifferential £> 1:+ v(£, x) of v S C((0, T) x Ti.) at 
(t, x) is given by the pairs (q,p) £ M. x Ji such that v(s, y) — v(t, x) — (p, y — x) — 
q(s — t) < o(\\x — y\\ + \t— s\), and the sub differential D 1 ~v(t,x) at (t,x) is 
the set of all (q,p) € K x H such that v(s, y) — v(t, x) — (p,y — x) — q(s — t) > 
— 2/|| H- |* — 
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Definition 3.1. Given v € C((0,T) x H) and (t,x) £ (0, T) x H we define 
E 1 '+v(t,x) as 

E 1 -+v{t,x) = {(q, Pl ,p 2 ) elx D(A*) x H : 3(p G testl, .9 G test2 s.t. 

v — tp — g attains a local 

maximum at (t,x), 

dt{(fi + g)(t,x) = q, 

Dip(t, x)=pi, Dg(t, x) = p 2 

and v(t, x) = ip(t, x) + g(t, x)} 

Remark 3.2. If we define 

E\' + v(t,x) — {(q,p) eRxTt : p = pi + p 2 with (q,pi,p 2 ) G E 1 - + v{t,x)} 

then E\' + v{t,x) C D^ + v(t,x) and in the finite dimensional case we have 
El' + v(t,x) = D 1 ' + v(t,x). Here we have to use E 1 ' + v{t 1 x) instead of E\ ,+ v{t,x) 
because of the different roles of g and ip. It is not clear if the sets E 1,+ v(t, x) and 
El' + v{t, x) are convex. However if we took finite sums of functions n(t)go(\\x\\) 
as testl functions then they would be convex. All the results obtained are un- 
changed if we use the definition of viscosity solution with this enlarged class of 
testl functions. 

Definition 3.3. A trajectory- strategy pair (x(-),u(-)) will be called an admissi- 
ble couple for (t,x) if u G U[t,T] and x(-) is the corresponding solution of the 
state equation 

A trajectory-strategy pair (x* (■) , u* (■)) will be called an optimal couple for 
(t, x) if it is admissible for (t, x) and if we have 

-co < J(t, x;u* (•)) < J(t,x;u(-)) 

for every admissible control u(-) £U[t,T], 

We can now state and prove the verification theorem. 

Theorem 3.4. Let Hvpotheses \2.1l [2~2 \ and \2.10\ hold. Let v G Q be a subsolu- 
tion of the HIB equation (0) such that 

v(T,x) = h(x) for all x in TL. (15) 

(a) We have v(t,x) < V{t,x) < J(t,x,u{-)) V(t,x) G (0, T] x H, u(-) € 
U[t,T}. 

(b) Let (t,x) G (0, T) x H and let (xt tX ('),u(-)) be an admissible couple 
at (t,x). Assume that there exist q G i 1 (i,T;R), p\ G L 1 ^, T; D(A*)) and 
P2 G L (t,T;7{) such that 

(q( s ) , Pi( s ) 7 P2(s)) G E 1,+ v(s, Xt tX (s)) for almost all s £ (t,T) (16) 

and that 

J ((Pi( s ) + P2{s),b(s,x t , x (s),u(s))) + q(s) + (A*pi(s),x t , x (s)))dt 

< -L(s,x t , x (s),u(s))ds. (17) 
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Then (xt )X (-),u(-)) is an optimal couple at (t,x) andv(t,x) = V(t,x). Moreover 
we have equality in tl7)) . 

Remark 3.5. It is tempting to try to prove, along the lines of Theorem 3.9, 
p. 243 of ]56$ . that a condition like tl7)) can also be necessary if v is a viscosity 
solution (or maybe simply a supersolution) . However this is not an easy task: 
the main problem is that E ,+ and the analogous object E 1 -^ are fundamentally 
different so a natural generalization of a result like Theorem 3.9, p. 243 of ]50$ 
does not seem possible. Moreover our verification theorem has some drawbacks. 
Condition fl7\) implicitly implies that < P2{r), Axt, x (r) >— a.e. if the trajec- 
tory is in the domain of A. This follows from the fact that we would then have 
an additional term < P2(r), Axt, x (r) > in the integrand of the middle line of 
120]) so ( T77j) would also have to be an equality with this additional term. There- 
fore the applicability of the theorem is somehow limited as in practice I117\) may 
be satisfied only if the function is "nice" (i.e. its super differential should really 
only consist of p\). Still it applies in some cases where other results fail (see 
Remarks Iff. 61 and \3.8fy . Many issues are not fully resolved yet and we plan to 
work on them in the future. 

Proof. The first statement (v < V) follows from Hypothesis I2.10[ it remains to 
prove second one. The function 

( [t, T] -> H x K 

\ s>-^ (b(s,x t , x (s),u(s)),L(s,x t>x (s),u(s)) 

in view of Hypotheses 12.11 and 12.21 is in L 1 {t,T;Ti x R) (in fact it is bounded). 
So the set of the right-Lebesgue points of this function that in addition satisfy 
lfT6|) is of full measure. We choose r to be a point in this set. We will denote 

V = x t , x (r). 

Consider now two functions ip r ' v £ testl and g r ' v € test2 such that (we 
will avoid the index r,y in the sequel) v < ip + g in a neighborhood of (r,y), 
v(r,y) - (p(r,y) - g(r,y) = Q,(d t )(<p + g)(r, y)) = q(r), Dcj)(r,y) = pi{r) and 
Dg{r, y) = P2(r). Then for r € (r, T) such that (t — r) is small enough we have 
by Lemmas [277] and l2~8l 

v(t, xt.xjr)) - v(r, y) < g{r, x t , x {r)) - g(r, y) tpjj, x t , x {r)) - ip(r, y) 
t — r t — r t — r 



. , , , Ir ( D 9(r,y),b(r,y,u(s)))ds 
< 9t{r, y) H 

T — T 

_l I ^ 1 Ir (D<p(r,y),b(r,y,u{s)))ds 

+ <Pt{r,y) + — h (A Dtp{r,y),y) + o(l). 18 

r — r 



In view of the choice of r we know that 

Jr ( D 9( r ,y),K r ,y, u ( s ))) ds r- 



(Dg(r, y),b(r,y,u(r))) 
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and 

(D(p{r,y),b(r,y,u(s)))ds T ^ r 

> {Dip{r,y),b{r,y,u{r))) . 

t — r 

Therefore for almost every r in [t, T] we have 
j. V ( T , x t,x(r)) - v(r, x t , x {r))) 

Tlr T-r 

< (Dg(r, x t . x (r)) + Dtp(r, x t<x (r)), 6(r, x t . x {r),u(r))) 
+ 9t{r, xt,x{r)) + ¥>t(r, x t , x (r)) + (A*D<p(r, x tjX (r)),x t , x (r)) 
= (pi(r)+P2(r),b(r,x t}X [r),u(r)))+q(r) + {A* Pl (r),x t}X (r)). (19) 

We can then use Lemma 12.111 and lfT7|) to obtain 

v{T, x t<x (T)) - v(t,x) 

< J {(p(r),b(r,x t , x (r),u(r))) + q(r) + (A* P i(r),x t , x (r)))dr 

< £ -L(r,x t . x {r),u{r))dr. (20) 

Thus, using (a), we finally arrive at 

V(T, x t ,x(T)) - V(t, x) = h(x t , x (T)) - V(t, x) < h{x t , x {T)) - v(t, x) 

= v(T,x t , x (T))-v(t,x) < [ -L(r,x ttX {r),u{r))dr (21) 



which implies that (xt, x {-), is an optimal pair and that v(t, x) — V(t, x). □ 

Remark 3.6. In the book (page 263, Theorem 5.5) the authors present a 
verification theorem (based on a previous result of [22], see also [21] for similar 
results) in which it is required that the trajectory of the system remains in the 
domain of A a.e. for the admissible control u(-) in question. This is not required 
here and in fact this is not satisfied in the example of the next section. 

It is shown in JJ^jj ( under assumptions similar to Hypotheses \2.1\ and \2.2\l 
that the couple x(-),u(-)) is optimal if and only if 

e f e u ^ V(( s + 6),x(s) + 5(Ax( S ) + bjs, x(s), u))) - Vjs, g(g)) 

= -L(s,x(s),u)X (22) 
for almost every s € [t, T], where V is the value function. 
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3.1 An example 

We present an example of a control problem for which the value function is 
a nonsmooth viscosity solution of the corresponding HJB equation, however 
we can apply our verification theorem. The problem can model a number of 
phenomena, for example in age-structured population models (see |39[ \T\ [40]) . 
in population economics [35J, optimal technology adoption in a vintage capital 
context [i"3l[T4] . 

Consider the state equation 

x(s) =Ax(s) +Ru(s) 

x(t) = x [Z6) 

whereA is a linear, densely defined maximal dissipative operator in H, R is a 
continuous linear operator R : K — * H, so it is of the form R: hh u/3 for some 
(3 £ Ti.. Let B be an operator as in Section [4] satisfying (|30fl . We will be using 
the notation of Section [H 

We will assume that A* has an eigenvalue A with an eigenvector a belonging 
to the range of B. 

We consider the functional to be minimized 

f T 1 

J(x,u(-)) = -\(a,x( S ))\ + -u( S ) 2 ds. (24) 



We define 

def _ 

and we take M — sup tg [ 0T ] I |. We consider as control set U the 

compact subset of R given by U — [-M — 1, M + 1]. So we specify the gen- 
eral problem characterized by HJ and |(2]) taking b(t,x,u) = Ru, L(t,x,u) — 
- \{a,x(s))\ + l/2u(t) 2 , h = 0,U = [-M- 1,M+1]. 
The HJB equation J8]) becomes 

v t + {Dv,Ax) - \(a,x)\ +mf ueU ((u,R*Dv) R + \u 2 ) = 
v(T, x) = ' 

Note that the operator R* : H — * M can be explicitly expressed using (3 which 
was used to define the operator R: R*x — {(3, x). 

Now we observe that for (a, x) < (respectively > 0) the HJB equation is 
the same as the one for the optimal control problem with the objective functional 
J t (a, x(s)) + ^u(s) 2 ds (respectively J t — (a, x(s)) + ^u(s) 2 ds) and it is known 
in the literature (see [34] Theorem 5.5) that its solution is 

T 1 

1 ,„*_/ ,,2 



(respectively 



Vi(t, x) = (a(t),x) — j — (R*a(s)) ds 



v 2 (t,x) = - (a(t),x) - j - {R*a{s)Yd S ). 



T 1 

1 ,,2 
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Note that on the separating hyperplane (a,x) = the two functions assume the 
same values. Indeed, since a an eigenvector for A*, 



a(t) = G(t) 



a 



where 



So, if (a, x) = 0, 



T 



G(t) = / e^-'Ms 



{a(t),x) = for all t G [0,T]. 
Therefore we can glue Vi and v 2 writing 



W(t,x) 



vi(t, x) if (a, x) < 
V2(t, x) if (a, x) > 



It is easy to see that W is continuous and concave in x. We claim that W is a 
viscosity solution of (|2"5| . For (a,x) < and (a,x) > it follows from the fact 
that vi and V2 are explicit regular solutions of the corresponding HJB equations. 
For the points x where (a, x) = it is not difficult to see that 

f D^+W^x) = {^(R*a(t) f }1 G(t)a) : 7 G [—1, 1] j C D(A*) 
\ D^-Wfax) = 

So we have to verify that W is a subsolution on (a, x) = 0. If W — <p — g 

def def 

attains a maximum at (t,x) with (a,x) = we have that p = (pi + P2) = 
D(tp + g)(t,x) G {7G(t)a : 7 G [-1,1]} C D(A*). From the definition of testl 
function jn = Dip{t,x) G £>(A*) so r?(*)So(M)#[ = P2 = Dg(t,x) G D(>4*). 
is a C 1 function and then, recalling that (a(t),x) t — (G'(t)a,x) = 0, 

we have 

d t (<p + g){t, x) = d t W(t, x) = \ (R*a(t) f , (26) 
and for p — 7a (t) we have 

mf ((Ru,p) + l -u^j = -1 7 2 {R*a{t)f (27) 

Moreover, recalling that 5o(l x l) — an d —^4* is monotone, we have 

(A* Pl ,x) = (A*(p-p 2 ),x) = (A* 7 G(t)a,x) ~ ^ (A*x,x) > 

\x\ 

>jG{t){A*a,x)=Q (28) 



So, by 126]), (221) and J28J, 

d t (^ + 5 )(i,a;) + (A*pi,a;) - |(a,x)| + 

+ inf f (Ru, D[fp + ff )(t, z)) + \u 2 ) > £(1 - 7 2 ) (#*a(s))' > (29) 
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and so the claim in proved. 

It is easy to see that both W and the value function V for the problem are 
continuous on [0,T] x H and moreover i\> — W and tfj — V satisfy 

\1>(t,x)-il>(t,y)\ <C||z-2/||_i for all tG [0, T], x, y G W 

for some C > 0. In particular W and V have at most linear growth as ||x|| — ► oo. 
By Theorem I2.9[ the value function V is a a viscosity solution of the HJB 
equation ([25]) in (0, T] x H. Moreover, since a = By for some y 6H, comparison 
holds for equation 1(25)1 which yields W — V on [0, T] x (Comparison theorem 
can be easily obtained by a modification of techniques of |29] but we cannot 
refer to any result there since both V and W are unbounded. However the 
result follows directly from Theorem 3.1 together with Remark 3.3 of [43]. The 
reader can also consult the proof of Theorem 4.4 of [44]. We point out that our 
assumptions are different from the assumptions of the uniqueness Theorem 4.6 
of [46], page 250). 

Therefore we have an explicit formula for the value function V given by 
V(t, x) = W(t,x). We see that V is differentiable at points (i, x) if (a, x) ^ 
and 

a{t) if (a, x) < 
—a(t) if (a, x) > 

and is not differentiable whenever (a, a;) = 0. However we can apply Theorem 
and prove the following result. 



-<fta(t)) if (a,x) <0 
(0,a(t)) if{a,x)>0 



DV(t,x) = 



Proposition 3.7. The feedback map given by 
u op (t,x) -- 

is optimal. Similarly, also the feedback map 

,-,°P(t ^ - / ~ (^'"W) if ( a > x ) < 
V> x >-\ (f3,a(t)) if (a,x)>0 

is optimal. 

Proof. Let (t,x) € (0, T] xTi.be the initial datum. If {a, x) < 0, taking the 
control — (f3,a(t)) the associated state trajectory is 

x op {s) = e {s - t)A x- f e {s - r)A R{{f3,a(r)))&r 



and it easy to check that it satisfies (a,x op {s)) < for every s > t. Indeed, 
using the form of R and the fact that a is eigenvector of A* we get 

(a, x op (s)) = e A(s - 4) (a, x) - (a, (3) J e x{s ~ r) {0, o(r)) dr 
= e^-') (a,x) - (a,/3) 2 /' e x ^- r) G{r)dr. 
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Similarly if (a,x) > 0, taking the control (f3,a(t)} the associated state tra- 
jectory is 

x op {s) = e {s ~ t)A x+ f e is - r)A R((l3,a(r)))dr 



and it easy to check that it satisfies (a,x op (s)) > for every s>t. 
We now apply Theorem 13,41 taking q(s) — dtV(s, x op (s)), 



PiO) = 



a(s) if (a,x op (s)) < 
-a{s) if {a,x op (s)) > 



andp 2 (s) = 0. It is easy to see that (q(s),p 1 (s),p 2 {s)) € E 1 ' + V(s, x op (s)). The 
argument for u op is completely analogous. □ 

We continue by giving a specific example of the Hilbert space H, the operator 
A, and the data a and (5. This example is related to the vintage capital problem 
in economics, see e.g. |H EBJ- Let H = L 2 (0, 1). Let {e tA ; t > 0} be the 
semigroup that, if we identify the points and 1 of the interval [0, 1], "rotates" 
the function: 

e tA f(s) = f(t + S -[t + S ]) 

where [■] is the greatest natural number n such that n < t + s. The domain of 
A will be 

D(A) = {feW 1 - 2 (0,l) : /(0) = /(l)} 

and for all / in D(A) A(f)(s) — j^f(s). We choose a to be the constant 
function equal to 1 at every point of the interval [0, 1] . (We can take for instance 
B = (I — A)~2.) Moreover we choose /3(s) = X[o,A]( s ) ~ X[o,i]( s ) (Xo 1S the 
characteristic function of a set fl). Consider an initial datum (t,x) such that 
(a,x) — 0. In view of Proposition 13.71 an optimal strategy u op is 

u° p (s) = -(p,a(s))=0 

The related optimal trajectory is 

x op {s) = e {s - t)A y. 

Remark 3.8. We observe that, using such strategy, (a, x op (t)) — for all s > t. 
So the trajectory remains for a whole interval in a set in which the value function 
is not differentiable. Anyway, applying Theorem \3.4\ the optimality is proved. 
Moreover x can be chosen out of the domain of A and so the assumptions of 
the verification theorem given in 146] (page 263, Theorem 5.5) are not verified 
in this case. 



4 Sub- and superoptimality principles and con- 
struction of e-optimal controls 

Let B be a bounded linear positive self-adjoint operator on H such that A*B 
bounded on TL and let cq < be a constant such that 

((A*B + c B)x,x) < for all x en. (30) 
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Such an operator always exists [49] and we refer to [28] for various examples. 
Using the operator B we define for 7 > the space H- 7 to be the completion 
of H under the norm 

\\x\\^ = \\Bix\\. 
We need to impose another set of assumptions on b and L. 

Hypothesis 4.1. There exist a constant K > and a local modulus of conti- 
nuity u>(-,-) such that: 

\\b(t,x,u) - b(s,y,u)\\ < K\\x-y\U+u>{\t - s\, \\x\\ V ||y||) 

and 

\L(t,x,u) - L{s,y,u)\ < cj{\\x - y\\- X + \t- s\, \\x\\ V ||y||) 

Let m > 2. Modifying slightly the functions introduced in [29j we define for 
a function i«:(0,r)xH^l and e, (3, A > its sup- and inf-convolutions by 

w x >^(t,x) = sup {w(s,y) - H*- ^-* - iizjl! _ Xe 2mK ^\\y\\ 



(»,j)6(0,T)x« 



2e 2/3 



Lemma 4.2. Lei w; fee such that 

w(t,x) < C{1 + \\x\\ k ) {respectively, w(t,x)> -C{l + \\x\\ k )) (31) 
on (0, T) xTi for some k > 0. Lei m > k. Then: 

(i) For every R > i/iere exists Mn,e,i3 such that if v — w ' e 'P (respectively, 
v = WA,e,/3 ) then 

\v(t,x)-v{s,y)\<M R>e>0 (\t-s\ + \\x-y\\- 2 ) on (0.T) x B R (32) 
(iij The function 

m w (t , l) + Mk + ii 

is convex (respectively, 

Ml 2 -i * 2 



WX,e,f3(t,x) 



2e 2/3 
is concave). 

(Hi) If v = w x - e -P (respectively, v = w\. ei p) and v is differ entiable at (t,x) € 
(0,T) x Br then \vt(t,x)\ < Mr. € ^, and Dv(t,x) = Bq, where \\q\\ < 



1.5 



Proof, (i) Consider the case v = w X ' e '@ . Observe first that if ||x|| < R then 

W X ' e ' (t,x) = 

f I \ \ X ~V\-X (t ~~ s ) 2 \ 2mK(T-s)\\ || 

sup <w(s,y) — Ae zm "^ ">\\y\\ 



(«,v)e(o,T)xH, ||al|<JV 



2e 2/3 



(33) 



where JV depends only on R and A. 

Now suppose w x ' e '^(t, x) > w x,c ^{s,y). We choose a small a > and (i, i) 
such that 

ti^fos) < o + w(t,x) - "^J"- 1 - - Ae 2 ™^)||i|r. 

Then 

(t-t) 2 , p-yll 2 .! , (t-s) 2 



\w x ^(t,x)-w x ^ f3 (s,y)\ < g 
< a 



2e 2/3 2e 2/3 

(Bfc-l^ar + i/) , {B(x-y),x) , (2i- t - - s) 



2e e 2/3 

(2i? + AH , ... 2T, 
< V ^ ^ ||fl( a; -y)|| + — jt-al+g (34) 

and we conclude because of the arbitrariness of a. The case of w\ >ei is similar. 

(ii) It is a standard fact, see for example the Appendix of [27] . 

(iii) The fact that \v t (t,x)\ < is obvious. Moreover if a > is small 
and \\y\\ = 1 then 

aMR t e,0\\y\\-2 > \v(t, x + ay) - v(x)\ = a\ (Dv(t,x),y) \ + o(a) 

which upon dividing by a and letting a — ► gives 

\{Dv(t,x),y)\<M R , e>0 \\y\\^ 

which then holds for every y £ H. This implies that (Dv(t, x), y) is a bounded 
linear functional in TL-2 and so Dv(t, x) = Bq for some q £H. Since | (q, By) \ < 
M R ^ p \\By\\ we obtain || 9 || < M R ^. □ 

Lemma 4.3. Let Hypotheses \2.1\ \2.2\ and \4- 1\ be satisfied. Let w be a locally 
bounded viscosity subsolution (respectively, super solution) of {2|) satisfying {Hp. 
Let m > k. Then for every R, S > there exists a non-negative function 
7fl,<s(A, e, /?), where 

Una limsuplimsup7ft i «5(A, e, (3) = 0, (35) 
A-»o £ ^ /3->0 

smc/i i/iai ui x ' e 'P (respectively, wx.e.p) is a viscosity subsolution (respectively, 
supersolution) of 

v t (t, x) + (Dv(t, x), Ax) + H(t, x, Dv(t, x)) = ~^ R s {\ e, /3) in (S, T - 5) x B fl 

(36) 
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(respectively, 

v t (t, x) + {Dv(t, x),Ax) + H(t, x, Dv(t, xj) = j R S (X, e, (3) in [5, T - 5) x B R ) 

(37) 

for (3 sufficiently small (depending on 5). 

Proof. The proof is similar to the proof of Proposition 5.3 of [29]. We notice 
that w X ' e, P is bounded from above. 

Let (to,Xo) £ (5, T — 5) x H be a local maximum of w X ' t ' 13 — <f> — g. We 
can assume that the maximum is global and strict (see Proposition 2.4 of [29] ) 
and that w ' e 'P — <p — g — ► — oo as — > oo uniformly in t. In view of these 
facts and f33|) we can choose S > 2||a;o||, depending on A such that, for all 
||z|| + ||2/||>S-landMe(0,T), 

Hs,y) - yJ( x - v)t-i i - L 2fr ' Xe2mKlT ' s) \\y\\ m - W,x) - g (t,x) 

< w(t ,x ) - Xe 2mK ^ T -^\\x \\ m ~ <Kto,x ) - g(t ,x ) - 1. (38) 

We can then use a perturbed optimization technique of [29j (see page 424 there) 
which is a version of the Ekeland-Lebourg Lemma [33j to obtain for every a > 
elements p,q £H and a,b £ R with \\p\\, \\q\\ < a and \a\, \b\ < a such that the 
function 

^t,x,s,y) & w(s,y) - ^\\{x-y)\\\ \e^ K ^\\y\r 

- g(t, x) - <f>(t, x) - {Bp, y) - {Bq, x) - at - bs (39) 

attains a local maximum (t, x, s, y) over [5/2, T— 5/2] x Bsx [5/2, T—5/2] x Bs- 
It follows from l|38p that if a is sufficiently small then ||x||, ||y|| < S — 1. 

By possibly making S bigger we can assume that (0, T) x Bs contains a 
maximizing sequence for 



sup \w(s,y) 



(s,j/)e(0,T), ||y||<JV 

Then 



11*0-011-1 _ fa - S ) 2 _ A .2mK(r-.)|| u i| 

2e 2/3 l|y " 



^(t, x, s, y) > w x,e ' (t o , ^o) - 0(*o, x ) ~ 0(*o, «o) - 
where the constant C does not depend on a > 0, and 

x, s, y) < w x ' e ^(t, x) - (f>(t, x) - g(t, x) + Ca. 

Therefore, since (to,xo) is a strict maximum, we have that (i,x) (to,Xo) 
and so for small a i £ (5,T — 5). It then easily follows that if (3 is big enough 
(depending on A and 5) then s £ (5/2, T — 5/2). 

Moreover, standard arguments (see for instance [41]) give us 
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limlimsup^— ^ =0, (40) 

/3->-0 Q ^o £P 

I ^ y I i 

lira lim sup lim sup — = 0. (41) 

We can now use the fact that w is a subsolution to obtain 

{i ~ §) 2XmKe^ T -ny\\ m + b i^E^Ml + {A * Bp , $ 







H^y^-Biy-^ + Xme^^-^hr^^+B^j > 0. (42) 



We notice that 

(t—s) ,- _. .- _. 
— = 9t(t,x) + g t {t,x) +a 

and 

-B(y -x) = D<j>(t, x) + Dg(i, x) + Bq 

which in particular implies that Dg(i,x) € D(A*), i.e. x € D(A*), and so it 
follows that (A*x, Dg{t, x)) < 0. Therefore using this, the assumptions on b and 
L, and (f40| and (j4l| we have 

4>t{i,x) +g t (t,x) + (x,A*D<j>(t,x)) + H (t,x, D<j>(i,x) + Dg(i,x)) 
> 2XmKe 2mK( - T -^\\y\\ rn - (A*Bp,y) -a-b 

(y - x), A*^B(y - x)j - (x, A*Dg(t, x) + A*Bq)) 
+H (t, x, l -B{y - x) - Bq^j -H (s, y, ^B(y - x) + Xnu^P-^y^ 1 -^ 
> 2XmKe 2mK ^ s '>\\y\r ~ C x , £ a + *\\x - y\\-i 

- K\\x - y\\-i mi6 ~ m ~ 7A,e(|* - 5|) " Xm(M + y|| )e 2 ^^-^) || y 
e 

> -C x , e a-f(X,e,0,a) (43) 

for some 7(A, e, 0, a) such that 

lim lim sup lim sup lim sup 7(A, e, 0, a) = 0. 

e ^o /3->0 Q-+0 

We obtain the claim by letting a — > 0. The proof for w x .p^ is similar. □ 

Remark 4.4. Similar argument would also work for problems with discounting 
if w was uniformly continuous in | • | X || • norm uniformly on bounded sets 
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of (0,T) x H. Moreover in some cases the function j Rj g could be explicitly 
computed. For instance if w is bounded and 

\w(t, x) - w(s,y)\ < a(\\x - + a x {\t - s\; \\x\\ V \\y\\) (44) 

for t,s G (0,T), ||x||, ||y|| G 7Y, we can replace Ae 2mK(T ~ 5) ||y|j m 6j/ A/i(y) for 
some radial nondecreasing function /i smc/i iftai Z?/i is bounded and — > +00 
as ~~ * 00 f see Jffffl P a <? e -(f we iften replace the order in which we pass 

to the limits we can get an explicit (but complicated) form for j R j satisfying 

lim limsup limsup7ij i( 5(e, A, /5) =0. 

The proofs of Theorem 3.7 and Proposition 5.3 in [29] can give hints how to do 
this. 

Lemma 4.5. Let the assumptions of Lemma \4.3\ be satisfied. Then: 

(a) If(a,p) G D l -w x ' e ' [t,x) for (t,x) G {5,T - 5) x B R then 

a+(A*p,x)+H(t,x,p) > -j RjS (X,e,l3) (45) 
for (3 sufficiently small. 

(b) If in addition H(s,y,q) is weakly lower- semicontinuous with respect to 
the q-variable and (a,p) G D 1 > + W\ l e t p(t,x) for (t,x) G (S, T — 5) x B R 
is such that Dw\ je> p(t„,x n ) — p for some (t n ,x n ) — > (t, x), (t n ,x n ) G 
(<5,T-<5) x Sfl, then 

a+ (A*p,x) +H(t,x,p) < jR,g(\,e,f3) 

for sufficiently small. 

Remark 4.6. The Hamiltonian H is weakly lower-semicontinuous with respect 
to the q-variable for instance if U is compact. To see this we observe that thanks 
to the compactness of U the infimum in the definition of the Hamiltonian is a 
minimum. Let now q n — ^ q and let 

H(s, y, q n ) = (q n ,b(s, y, «„)) + L(s, y, u n ) 

for some u n G U . Passing to a subsequence if necessary we can assume that 
u n — ► u, and then passing to the limit in the above expression we obtain 

liminf H(s,y,q n ) = (q,b(s,y,u)) + L(s,y,u) > H(s,y,q). 

n — >oo 

We also remark that since H is concave in q it is weakly upper-semicontinuous 
in q. Therefore in (b) the Hamiltonian H is assumed to be weakly continuous 
in q. 
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Proof, (of Lemma Recall first that for a convex/ concave function v its 
sub/super-differential at a point (s,z) is equal to 



conv{((a,p) : v t (s n , z n ) -> a, Dv(s n , z n ) -» p, s n -> s, z n -> z} 

(see [48], page 319). 

(a) Step 1: Denote w = w A,£,/3 . At points of differentiability, it follows from 
Lemma l4~27 iii) and the "semiconvexity" (see Lemma l4~2T ii)) of u> A ' e ' /3 that there 
exists a testl function <p such that v — ip has a local maximum and the result 
then follows from Lemma l4~3l 

Step 2: Consider first the case Dv{t n , x n ) — 1 p with (i„, £„) — > (t, x). From 
Lemma H21 (iii) Dv(t n ,x n ) — Bq n with ||g n || < M H ^ y p, so, it is always possible 
to extract a subsequence q nk — q for some q EH. Then Dv(t nk , x nk ) = Bq nk — s - 
-Bg and = p. Therefore 

(A-Bg^sO = (^,(^5)*^) — » (9,(^5)^) = = <A*p, x) 

Moreover, since H is concave in p it is weakly upper-semicontinuous so we have 

H(t,x,p) > lim sup H (t nk , x nk ,Dv(t„ k ,x nh )) 

k — >+oc 

and we conclude from Step 1. 

Step 3: If p is a generic point of convjp : Dv(t n , x n ) — * p, (t n ,x n ) — > (i, x)}, 
i.e. p = limn^oo ELi KBq?, where A ? = 1. Il??ll < M R,e,P> and the B# 
are weak limits of gradients. By passing to a subsequence if necessary we can 
assume that J2i=i ^"9™ — 1 9 an d P = Bq. But then 

(j2KBq'?j ,x n J = (a*B (]C > x ^j - (A*Bq,x) = (A*p,x) 

as n — > oo. The result now follows from Step 2 and the concavity of 

P >-> a?) + H(t, x,p). 

(b) As in (a) at the points of differentiability the claim follows from Lemmas 
14.21 and 14.31 Denote v — w\,e,p- If Dv(t„,x n ) — 1 p for some {t n ,x n ) — > (t, x), 
(t n , a; n ) € (5, T — <5) x Br we have that 

Vt(t n , x n ) + (A*Dv(t ) + H(t n ,x n ,Dv(t n ,x n )) < jR,s(X,e,/3). (46) 

Observing as in Step 2 of (a) that 

(A*Dv(t n ,x n ),x n ) -> (A*p,ar) 

we can pass to the limit in f46|) , using the weak lower semicontinuity of H with 
respect to the third variable, to get 

a + (A*p, x) + H(t, x,p) < -y R ,s(\, e, f3). 

□ 
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Theorem 4.7. Let the assumptions of Lemma \4-3\ be satisfied and let w be a 
function such that for every R > there exists a modulus ctr such that 

\w(t,x)-w(s,y)\ < o-jiCI*— *|H-l|a:— for t, s e (0, T), \\x\\, \\y\\ < R. (47) 

Then: 

(a) If w is a viscosity subsolution of {#)) satisfying (31\) for subsolutions then 
for every 0<t<t + h<T,x^Ti 

f f t+h \ 
w(t,x) < inf < / L(s, x(s), u(s))ds + w(t + h, x(t + h)) > . 

u(-)£U[t,T] \J t J 

(48) 

(b) Assume in addition that H(s,y,q) is weakly lower-semicontinuous in q 
and that for every (t, x) there exists a modulus u>t, x such that 

\\xt,x{s2) - X t ,x(si)\\ < LO t ,x(s2 - Si) (49) 

for all t < s\ < S2 <T and all u(-) £ U[t,T], where x t . x (-) is the solution 
of {^). If w is a viscosity supersolution of 0) satisfying $31\) for superso- 
lutions then for every 0<t<t + h<T,x^H, and v > there exists a 
piecewise constant control u v S U[t,T] such that 

rt+h 

w(t,x)> / L(s,x(s),u v (s))ds + w(t + h,x(t + h))-v. (50) 
In particular we obtain the superoptimality principle 

w(t,x)> ^inf^jj^ L(s,x(8),u(s))ds + w(t + h ) x(t + h))j (51) 

and if w is the value function V we have existence (together with the 
explicit construction) of piecewise constant v-optimal controls. 

Proof. We will only prove (b) as the proof of (a) follows the same strategy after 
we fix any control u(-) and is in fact much easier. We follow the ideas of [52] 
(that treats the finite dimensional case). 

Step 1. Let n > 1. We approximate w by w\ t<ii p with m > k. We notice 
that for any u(-) if xt, x {-) is the solution of © then 

sup \\x t<x {s)\\ <R = R{T,\\x\\). 

t<s<T 

Step 2. Take any (a,p) G D 1 - + w\^^{t,x) as in Lemma l4~5T b) (i.e. p is the 
weak limit of derivatives nearby). Such elements always exist because w\ yt ^ is 
"semiconcave". Then we choose u\ e U such that 

a + (A*p, x) + (p, b(t, x, m)) + L(t, x, ui) < j R ,s(X, e,/3) + -^. (52) 
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By the "semiconcavity" of W\ >et p 
w\e,p(s, y) < w\,e,i3(t, x) + a(s -t) + (p, y - x) H — -1 H — — . (53) 



2e 



2/3 



But the right hand side of the above inequality is a testl function so if s > t 
and x(s) — Xt yX {s) with constant control u{s) = u\, we can use lfT2|) and write 



a(s -t) + ( P ,x(s) -x} + "^V" 2 ' 1 + ^ 



s - t 

- (a + {p,6(i,a;,ui)) + (A*p,a;)) 



< 



]*-*[ 

2/3 



J x(r) — x) dr 



s - t 



ft (p,K r , x ( r ), u i) -b(t,x,ui))dr 



s-t 



J f s (A*B(x(r) -x),x(r)) dr 



e(s - t) 



// (B(x(r) - x),b(r,x(r),Ui)) dr 



e(s - t) 

< u' t (\s-t\ + sup \\x(r) - x\\) < u t ,Js - t) (54) 

t<r<s 



for some moduli ui' t x and (bt,x that depend on (t, x),e,/3 but not on u\. We can 
now use ll52l. ll53l) and (l54l) to estimate 



h/n 



< oj t , x ( - ) + 1r.s{X, e, 0) + -j - ui) (55) 



Step 3. Denote tj = f + for i = 1, ...,n. We now repeat the above 

procedure starting at 2^2) to abtain U2 satisfying l(55|) with (£2,2^2)) replaced 
by (t3,x(t3)), (t,x) = (ti,x(t{)) replaced by (t2,x(t2)), and u% replaced by u-i. 
After n iterations of this process we obtain a piecewise constant control vS n ', 
where u^ n '(s) = u, if s e [ti,ti+i). Then if x(r) solves ((!]) with the control u 
we have 



(«) 



W\,e,(i{t + h, x(t + h)) - WX,e,/3(t, x) 

h/n 



< &t,x ( - ) n + 7k : s(A, e,/3)n + — ^ 
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We remind that l|49p is needed here to guarantee that sup t ._ 1<r<( . \\x(r) — 
is independent of Ui and and depends only on x and t. We 

then easily obtain 

W\,e,p{t + h, x(t + h)) - Wx,e,p(t, x) 

< ij t , x (^j h + lR! s(\, e, 0)h + A _ £ + L (r, x(r),u^)dr + Co' t , x (~j h 

(56) 

for some modulus Q' t x , where we have used Hypothesis 14.11 and (|49| to estimate 
how the sum converges to the integral. We now finally notice that it follows 
from S2J that 



\w\,cA*,v)- w (*,v)\ <°R(\ + e + f3;R) for s G (6, T - S), \\y\\ < R, 

where the modulus <tr can be explicitly calculated from or. Therefore, choosing 
f3,X,e small and then n big enough, and using lj35j) . we arrive at (|50|) . □ 



We show below one example when condition lj49l) is satisfied. 

Example 4.8. Condition {4 Sty holds for example if A = A* , it generates a 
differ entiable semigroup, and \\Ae tA \\ < C/t s for some S < 2. Indeed under 
these assumptions, if u{ ) G U\t, T] and writing x(s) — Xt tX (s), we have 

\\(A + I)ix(s)\\ < \\{A + I)^e^ A x\\ + J* \\(A + I)h^ A b{T,x(r),u{T))\\dT 

However for every y G H and < t < T 

\\(A + I)h^ A yf < \\(A + I)e TA y\\ \\y\\ < ^\\y\\ 2 . 

This yields 



\\(A + I)h^\\<^ 

T 2 

and therefore 

\\(A + I)lx(s)\\ < C 2 (—t—T + (s - i) 1 "*) < ' 



tp J ~ (a-*)* 

We will first show that for every e > there exists a modulus a e ( also depending 
on x but independent of u{-)) such that \\e^ S2 ~ Sl ^ A x{s\) — x{s\)\\ < er e (s2 — si) 
for all t + e < si < s% < T. This is now rather obvious since 



{s2 - Sl)A x{ Sl )~x{ Sl )= / Ae sA x( Sl )ds 



S2—S1 



e 



(A + I)h sA (A + I)ix( Sl )ds- / e sA x( Sl )ds 
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and thus 

i, e ( S2 - sl )A X(si) _ s(si) n < 11(4 + 7)^( S1 )n r si + ( S2 _ S1 )iix( si )n 

< ^(sa-sO^^+CsCsa-si). 

£2 

also notice that there exists a modulus a, depending on x and independent 
of u{ ), such that 

\\x(s) - x\\ < a(s - t). 
Let now t < si < s 2 < T. Denote s — max(si, t + e). If S2 < t + e then 

\\x(s 2 ) - x( Sl )\\ < 2a(e). 

Otherwise 

\\x(s 2 ) - x(si)\\ < 2a(e) + \\x(s 2 ) ~ x(s)\\ 

< 2a(e) + \\e {s2 - s)A x( Sl ) ~ x(s)\\ + J* \\e {s ^ A b{ T , x(t), u(t))\\(1t 

< 2cr(e) + a e (s 2 - si) + C 4 (s 2 - si) (57) 

for some constant C4 independent of u{ ). Therefore is satisfied with the 
modulus 

Wi, x (r)= inf {2a(e)+a e (T)+C(r)}. 

0<e<T-t 
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